Sparse Gaussian Conditional Random Fields: Algorithms, Theory, and Application to Energy Forecasting

نویسندگان

  • Matt Wytock
  • J. Zico Kolter
چکیده

This paper considers the sparse Gaussian conditional random field, a discriminative extension of sparse inverse covariance estimation, where we use convex methods to learn a high-dimensional conditional distribution of outputs given inputs. The model has been proposed by multiple researchers within the past year, yet previous papers have been substantially limited in their analysis of the method and in the ability to solve large-scale problems. In this paper, we make three contributions: 1) we develop a secondorder active-set method which is several orders of magnitude faster than previously proposed optimization approaches for this problem, 2) we analyze the model from a theoretical standpoint, improving upon past bounds with convergence rates that depend logarithmically on the data dimension, and 3) we apply the method to large-scale energy forecasting problems, demonstrating state-of-the-art performance on two real-world tasks.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Efficient Computations for Gaussian Markov Random Field Models with two Applications in Spatial Epidemiology

Gaussian Markov random fields (GMRFs) are frequently used in statistics, and in spatial statistics in particular. The analytical properties of the Gaussian distribution are convenient and the Markov property invaluable when constructing single site Markov chain Monte Carlo algorithms. Rue (2001) demonstrates how numerical methods for sparse matrices can be utilised to construct efficient algori...

متن کامل

Distributed Gaussian Conditional Random Fields Based Regression for Large Evolving Graphs

Dynamics of many real-world systems are naturally modeled by structured regression of representationally powerful Gaussian conditional random fields (GCRF) on evolving graphs. However, applications are limited to small and sparse evolving graphs due to high computational cost of the GCRF learning and inference. In this study, a new method is proposed to allow applying a GCRF model to large and ...

متن کامل

An Explicit Link between Gaussian Fields And

Continuously indexed Gaussian fields (GFs) is the most important ingredient in spatial statistical modelling and geo-statistics. The specification through the covariance function gives an intuitive interpretation of its properties. On the computational side, GFs are hampered with the big-n problem, since the cost of factorising dense matrices is cubic in the dimension. Although the computationa...

متن کامل

An explicit link between Gaussian fields and Gaussian Markov random fields: the stochastic partial differential equation approach

Continuously indexed Gaussian fields (GFs) are the most important ingredient in spatial statistical modelling and geostatistics. The specification through the covariance function gives an intuitive interpretation of the field properties. On the computational side, GFs are hampered with the big n problem, since the cost of factorizing dense matrices is cubic in the dimension. Although computatio...

متن کامل

NORGES TEKNISK-NATURVITENSKAPELIGE UNIVERSITET An explicit link between Gaussian fields and Gaussian Markov random fields: The SPDE approach

Continuously indexed Gaussian fields (GFs) is the most important ingredient in spatial statistical modelling and geo-statistics. The specification through the covariance function gives an intuitive interpretation of its properties. On the computational side, GFs are hampered with the big-n problem, since the cost of factorising dense matrices is cubic in the dimension. Although the computationa...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2013